Trees and Support Vector Machines

This notebook outlines my process of tree based and Neural Network models. This notebook is dependent on the data table gameInfo generated from DataExtraction.RMD.

Loading Data from other part

load("../data/league.RDATA")

Packages

library(tidyverse)
library(data.table)
library(randomForest)
library(rpart.plot)
library(word2vec)
library(Rtsne)
library(plotly)
library(keras)
library(tfruns)
library(rsample)

List to Store Results

data.tree <- list(
  models = list(),
  plots = list(),
  temp.data = list()
)
championCluster <- list(
  models = list(),
  plots = list(),
  temp.data = list()
)

Wrangling Data

So I want to make a basic tree classifier of projected winning team comps. For now, a basic model of simple champion tags will be used.

Setting up Training / Test Data

# Setting Seed for Reproducibility
set.seed(3)
data.tree$temp.data$sample <- sample(data.tree$temp.data$gameInfo.tree$match, nrow(data.tree$temp.data$gameInfo.tree)*.7)
data.tree$temp.data$train <- data.tree$temp.data$gameInfo.tree %>% 
  filter(match %in% data.tree$temp.data$sample)
data.tree$temp.data$test <- data.tree$temp.data$gameInfo.tree %>% 
  filter(!match %in% data.tree$temp.data$sample)

Generating Random Forest

set.seed(3)
data.tree$models$teamComp_forest <- randomForest(
  team_win ~ . - match,
  data = data.tree$temp.data$train,
  ntree = 500,
  importance = TRUE,
  na.action = na.omit
)

data.tree$models$teamComp_forest

Call:
 randomForest(formula = team_win ~ . - match, data = data.tree$temp.data$train,      ntree = 500, importance = TRUE, na.action = na.omit) 
               Type of random forest: classification
                     Number of trees: 500
No. of variables tried at each split: 3

        OOB estimate of  error rate: 50.08%
Confusion matrix:
      1     2 class.error
1 11396 12530   0.5236981
2 11377 12438   0.4777241

importance(data.tree$models$teamComp_forest)

                    1          2 MeanDecreaseAccuracy MeanDecreaseGini
Assassin_1  9.9540136  -6.814106            5.1561345         332.2679
Fighter_1  17.2205799 -13.858278            5.5311721         346.1510
Marksman_1  9.5225581  -8.116976            1.7123134         293.4874
Tank_1      7.4799838  -4.724412            3.9559451         285.2230
Mage_1     16.9019553 -14.924233            2.9464378         284.1115
Support_1  12.2424356 -11.952428            1.8623555         242.4686
Assassin_2  0.3371864  -2.088303           -2.3073435         359.3653
Fighter_2   2.4827423  -4.897604           -2.7091299         425.1212
Marksman_2  3.2506393  -4.942703           -1.7623174         369.9343
Tank_2      3.0022087  -5.144555           -2.4517398         338.7178
Mage_2      1.0833946  -1.633843           -0.6288478         389.8527
Support_2   0.6855808  -5.485852           -5.9403592         288.7111

varImpPlot(data.tree$models$teamComp_forest)

Let’s compare to a simple blue side always wins classifier:

data.tree$temp.data$gameInfo.tree %>% 
  count(team_win) %>% 
  mutate(n = n/sum(n))

Well, it’s slightly better than the naive blue side win classifier but clearly the number of champions with tags isn’t a very strong predictor of team success. With the current coding, I’m fairly certain that there won’t really be a robust classifier.

Let’s try to identify clusters of champion types. # Generating Input Team Sentences

championCluster$temp.data$teams <- gameInfo %>% 
  select(match, win, championName) %>% 
  group_by(match, win) %>% 
  mutate(championNumber = row_number()) %>% 
  pivot_wider(
    names_from = championNumber,
    values_from = championName
  ) %>% 
  transmute(match = match, win = win, team = str_c(`1`,`2`,`3`,`4`,`5`, sep = " ")) %>% 
  ungroup() %>% 
  select(team)

championCluster$temp.data$teams

Generating Model

Pretty clearly 5 main clusters of champions each corresponding to a role. Doesn’t really help too much in determining team compositions. I could set up a KNN to verify this but it seems pretty clear cut to me.

Neural Network

Wrangle Data

Running Model - See TeamCompNN.R

Hyperparameter Tuning

view_run("runs/2021-12-20T22-31-29Z")

Warning in utils::untar(source_tarball, exdir = source_tmp_dir, compressed = TRUE,  :
  argument 'compressed' is ignored for the internal method
Warning in readLines(file.path(source_dir, file)) :
  incomplete final line found on 'C:\Users\tzhan\AppData\Local\Temp\RtmpCKtyCd\file1f402f424b2b/source/TeamCompNN.R'

results

     loss  accuracy 
0.6917616 0.5213519 

52.14% accuracy, not the best, but not bad considering the variance of league of legends.

model %>% predict("Camille Talon Veigar Jihn Lux")

          [,1]
[1,] 0.5433422

A very weird way to code a team comp predictor - I’ll try a different method in Part 3.